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BACKGROUND OF THE INVENTION 
[Field of the invention] 



The present invention relates to computerised qraDhic svstGm<? anH ir, ^^^rf• ^ • ^- . 
engine which provides for the manipulation of image date ' ^'"'^'"""^ " ^^^^''^ 
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10 Desktop publishing systems are known in the art which enable a user to manipulate visual im«n. H.t. 

as to create or amend a visual Image in some manner. manipulate visual image data so 

Known systems generally have the capability of creatino blark anH lA/h.t^ .v«^^^ u- 
on either a monochrome display, or by use'of a SackTnd white ifser S^ ' 

However, there exists a demand for desktop publishina svstem^ that r^n^r^f^ * n . 
IS performance comparable to existing monochrome sys el tot^^^^^^ ''^^'If 
and image quality on the other. However, for colouU system^ the « of Sfa re^^ 

20 SUMMARY OF THE INVENTION 

In accordance with one aspect of the present invention there is disclosed a graphics enqine to manioul«f. 
colour video .mage data on a pixel-by-pixel basis, said engine comprising a parallerdaTa path fofeacr 
three primary colours of said image data, each said path comprising a cascade connecte^Intemltorfnd co^^ 
positor and said data paths being connected in parallel with a cascade rnn ^'^^^^ '"'enaoiatorand com- 

so and matte combiner, wherein each of said colour interpoLr.^ rec^itTctlorvSo^^^^^^^ 

compositors receive colour input data for each said pixel in turn and said composito~fot; saiS cc^^^^^ 
input data in accordance with a pre-determined function the output of which is deDenden7uTonr.,h L ^ 
colour data and the interpolator variation command, and wherein' aid transpj^en^ytnte^o^^^^^^^^^^^ 
parency vanation commands, and said matte combiner receives matte plane input data for each saf<^T^ran^^^ 

« said combiner produces a colour blend value and an output, matte vaL for each sJd p x^^^^^^^^^ 

said input matte data in accordance with said transparency variation commands, the ISofVarg 

0 output=rare=rn!mum-^^^^^^^^ 

ptinn '"^^"^^°^'^^«"9 '"ost significant of said bits to establish eithera step mode ora jump mode of ooer 

BRIEF DESCRIPTION OF THE DRAWINGS 

whict"'"''"" ^'-^^^^-"^ of the present invention will now be described with reference to the drawings in 
^m^TnZV'^"'""'" '''^""^ °' ^ ''"^^^ manipulation systems which incorporate a 

Fia" 3 is a Th^^ ^^^1 T^'^"" °' ''^ embodiment of the graphics engine; 

Fig. 3 IS a schemat c block diagram of the render processor interface of Fig 2- 
Fig. 4 IS a schematic block diagram of the first-in-first-out register of Fig 3 ' 

Flo' 1 1 1 Jn?. M°t °' generator'of Fig. 4; 

Fig. 6 IS a schematic block diagram of the control unit of Fig 2 

Fig. 7 IS a schematic block diagram of the run controller of Fig 2- 

Fig. 8 IS a schematic block diagram of the run length register of Fig 7- 
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Fig. 9 is a schematic block diagram of the run length counter of Fig. 

Fig. 10 Is a schematic block diagram of the ramp generator of Fig. 7; Figs. IIAand B illustrate the gener- 
ation of the ramp of the generator of Fig. 10; 

Fig. 12 is a schematic block diagram of one of the colour Interpolators of Fig. 2; 

Fig. 13 Is a schematic block diagram of the Interpolator A of Fig. 12; 

Fig. 14 Is a schematic block diagram of the Interpolator B of Fig. 12; 

Fig. 15 Is a schematic block diagram of one of the colour compositors of Fig. 2; 

Fig. 16 is a schematic block diagram of compositor A of Fig. 15; 

Fig. 17 is a schematic block diagram of the compositor B of Fig. 15; 

Fig. 18 is a schematic block diagram of the transparency interpolator of Fig. 2; 

Fig. 19 is a schematic block diagram of the transparency interpolator synchroniser of Fig. 18; 

Fig. 20 is a schematic block diagram of the transparency interpolator A of Fig. 18; 

Fig. 21 is a schematic block diagram of the transparency interpolator B of Fig. 18; 

Fig. 22 is a schematic block diagram of the matte combiner of Fig. 2; 

Fig. 23 is a schematic block diagram of the matte synchroniser of Fig. 22; 

Fig. 24 is a schematic block diagram of the matte delay of Fig. 22; and 

Fig. 25 is a schematic block diagram of the matte calculator of Fig. 22. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

As seen in Fig. 1 A, a simple form of image manipulation system takes the form of a general purpose com- 
puter 1 , a graphics engine 1 0, a work screen memory 30 of typically 3 Mbytes maximum and a screen or monitor 
3 capable of high resolution. In this system images stored in the computer 1 are able to be displayed on the 
monitor 3 and manipulated via the graphics engine 10 and the keyboard (not Illustrated) associated with the 
monitor 3. 

Another type of image manipulation system shown in Fig. 1 B Is associated with a colour laser copier 5 which 
is preferably the CANON CLC500 COLOR LASER COPIER (Registered Trade Mark). The copier 5 Includes a 
scanner 6 and printer 7 which are connected to a page store or memory 4. The page memory 4 Is typically 96 
Mbytes maximum for an entire A3 size 400 dots per Inch (dpi) Image. The data rate of this copier is 13.35 MHz 
which is substantially the same as a standard video broadcast data rate of 1 3.5 M pixels/second. The computer 
1 and graphics engine 10 are substantially as before. 

As indicated in Fig. 1C, it is possible to combine both the above systems by the provision of a data bus 26 
interconnecting the graphics engine 10, the work screen memory 30 and page store 4. With this configuration, 
a image read by the scanner 6 can be manipulated whilst displayed on the monlfor 3 and then printed out using 
the printer 7. 

Fig. ID illustrates a similar system save that a pan/zoom engine 9 Is provided between the data bus 26 
and the work. screen store 30 to further Increase the nature of the image data manipulations able to be perfor- 
med. 

The system of Fig. 1 E is concerned essentially with video images which can be either still video or lines 
of a live video for broadcast or other purposes. Here the graphics engine 10 provides an output (only) to a line 
store 40 which operates on the first in first out (FIFO) principle and which in turn outputs to a triple digital to 
analogue converter (DAG) 41 to provide the necessary output video signal. 

Lastly, as seen in Fig. IF. a inter-active video image manipulation system incorporates the computer 1 and 
graphics engine 10 as before, however, the graphics engine 10 both outputs data to. and receives data from, 
a double buffen-ed frame store 42. The frame store is able to receive video data from a video source 43 and 
output video data to a video destination 44. 

With the above applications In mind, the preferred embodiment of the graphics engine 10 of the present 
invention will now be described with reference to Fig. 2 and with general reference to an image manipulation 
system of the general type depicted In Fig. ID. 

It will be seen In Fig. 2 that the graphics engine 10 includes an input data bus 11. which provides a video 
input, and an output video data bus 19. Also included within the graphics engine 1 0 is a render processor (RP) 
interface 1 00. a run length controller 200, and a control unit 300. A data path includes interpolators 400 for each 
of red, green, and blue, a transparency Interpolator 600 as well as compositors 500 for each of red, green, and 
blue and a matte combiner 700. An address generator 800 and a write controller 900 are also provided. 

Commands enter the graphics engine 10 via the RP interface 100 and both the bus 12 which provides RP 
data and the bus 13 which provides RP control. Signal lines 14 provide for direct memory access (DMA) control. 
The control unit 300 accepts two clock signals 15 which include a pixel clock running typically at 13.35 MHz. 
The control unit 300 reads data from the RP interface 100, interprets those commands received, and passes 
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the command operands to the run controller 200 and to th^ ri^t^ r^o^K • . -i- . 

operands are also passed to the address gene^torro an^T^^ 'nterpolators 400. The command 

also responsible for decoding microcode from th se con^mands whTch is ' s'' ^""^ ^00 is 

execution devices within the engine 1 0. commands, which is subsequenOy used by respective 

The run controller 200 is initialised with the run lenoth nf the r.^^- ■ 
unit 300 and produces a linearly increasing number n fo^ of a^^^^^^^^ ^'^^ ''^^ control 
run. This ramp is used by the interpolators 400 to control theT^So!,^^ T ° *° "^"'^^'O" °f the 

Thegraphics engine 10 is configured tooperl ujonred^a^ commands, 
is an industry standard. The colour data pathTred greenlTbT.:^^^ 

a blend command, is initialised by the control un fsbo S a sterol r^^f"*^ ^'^^ 9^"^^^' of 

path produces a blend between these two colours, andrn comlsi^^^^ ^" .""^ "^'^ 
the current colour, in the pixel memory (work screen store 30 rnr*^ !^ ^ Percentage of 

transparency data path includes a transparencyTnte^pdator g^^^^^^^^ Th ^ "'l^^ "^^^ The 
of a transparency blend command, the fransparrncy dJroa^Zl " r ^2^^^^ "^^^''"P'^ -^^e 

transparency and an end transparency. The t^a^Sparencrd ^^0^!?^ with a start 

values, and the result is used to control the composiTq 1^^^^^^^ T ^ *wo 
rency blend can also be written or composited XlJrLTe oianeT^h '" "^ components. The transpa- 

The address generatorSOO provides the read and wrl oHH ^ ^""^^ 

4 addresses are maintained inde^end'dy frJ^those o^^ th^^^^^^^ '"^'"^^^-^O- The page memory 

page memory 4. which is interconnected to the buseJ ? and 19 vL h. « '"T^'^ "^^""^ ^^"^ 

the work screen memory 30. and visa versa ^ ^ and 19 via buffers, to occur in parallel with writes to 

The write controller 900 provides synchronised read and write sianal^; tn fh» • . 
to synchronise to the pan/zoom engine 9. the write controller 90rpfovX a iT^M T'""'^ 
m all execution units of the engine 1 0 when waiting for cor^Zro raa^ 1 . '° 
memory 30. The write controller 900 also maintains niDelTnJ o J.? . ^ ^''''^'^ ^° «<=^een 

used by other execution units. '"a-nta.ns a pipeline of status signals which contains the micro-code 

gree:^ndTue':facror~ '"v'-^- Into three component cotour.. red. 

posltor 500. The interpolators 400 are rIspSe for olnr^ 1'' ^^'^P"^'"^ ^" 'nterpolator 400 and a com: 
are responsible for mixing the blend Jh ^ pLS^^^^^^^ ^"'^ compositors 500 

posi:;^~.:xtrreer^^^^^^^^^^^^ 

compositors 500 with the mixing proportion lich J sele^s f^m ,1. T*""^' "''"''"'^^ ^^^^ ^*>'°"- 

The matte output is also fed to the red compoSto 500 wh^H.r l^f^' ""^"'"^ transparency sources, 

to the matte plane, to be written to the redXn^Ltead ^""^ "^^^ written 

w«. ''^ ^^"'^"^ ^'^--^ 

previous rrimard is SirS^n^^^^^ 2l thrcomm.T'"^"'' ""''^ '"^ the 

command is complete, the graphics Instmctfon" in iatL wTa ^ ^A^^^^ T 

the address generator 800 proceed in parallel and Tl J^ r f ^ ^'3"^'- ^''^ ^^'^ P^^^ ^^OO^SOO and 
the pixel clock PXCLK 15. A new pixel is tht^afte" e^ld "iT f °' ^'^'^'^ P-°^« - 
unless stalled by a peripheral device conneld to he en'?„^ T". ^ °^the instruction 

150 (Fig. 10 to be described hereafter) within^he n^n cS^e 2n]^^ instruction, a ramp generator 

0 to 255 and indicates to the controller 3oS when tL ?nT^ ^ ^ ""^^"•^ increasing numberfrom 

controller 900 interfaces to the pixel memo^4 30 olthe fr^mT.? " T^'T' "'^ ^ ^'S"^'" ^he write 

also interfaces to a further bus 20. sup^^^^g the oan^oom^^ ''1' ^1 . The write controller 900 

track of when and where to read and write pixels ^'"^ ^ •"^'"ory 30. and keeps 

"^^'^TZT,.^^^^^^ 10. These are: compositing com- 

mon type of instruction given to the engfne ?0 TnT^ZS^r ^"'"P''^'""^ '^O'^Tiands are the most corn- 
operations in the page store 4 and on'hescreeJ 3 v^^^^ 

used to set up internal or external hardwarrc?nnec«rnl prior to IZ"1- '^^•""'ands are 

sation commands are used to keep the araohS^ »t ^^^'^"ting compositing commands. Synchroni- 

hardware events. Ta bte 1 shows Kje ^L ° ^V^'^'^^nised to internal hardware events or external 

The source and destinatioro WendtioT/r.? ^"^ '^^'^ ^"P^ctive instruction codes, 

the woricscreen 3 (WS). AccoiSingfy Se' are o^r "^0^0^" """""^'""^ '^"'^'^ ^^^^ «^ 

compositing memo,y4;compositing within the ^*sJSr^^^^^ commands: compositing within the 

a nin tne workscreen memory 30; compositing from the compositing mem- 
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ory 4 to the workscreen memory 30; and compositing from the workscreen memory 30 to the compositing mem- 
ory 4. During CM to CM compositing, one pixel is read and written in every pixel clock period (75 ns). Reads 
are performed in the first half of the pixel clock periods and writes in the second half. The graphics engine 10 
uses a i pipeline delay system In which data is transferred sequentially between various devices within the 
5 engine 10. Accordingly, there is a delay between reading the "old" value of a pixel, and writing the "new" value 
of the pixel. For this reason, the compositing memory 4 address changes between the first and second halves 
of the pixel clock period. 

Due to timing constraints in the compositing memory 4, there is one pixel clock period delay between issuing 
a read address, and reading the data at that address. This delay is compensated for by adjusting the position 
10 within the graphics engine 10 pipeline where the read data is received. The compositing memory 4 also has a 
one clock delay when writing pixel data, but this does not affect the interna! operation of the graphics engine 
10. 

During WS to WS compositing, a maximum of one pixel is read or written in every pixel clock period (75 
ns). Reads are requested in one pixel clock period, and writes in another. Because of pipeline delays in the 

15 graphics engine 10, for the same reasons as described above, the workscreen memory 30 address changes 
between successive read and write requests. 

Due to timing constraints in the workscreen memory 30, there can be a delay between issuing a read 
request, and reading the data at that address. Handshake signals from the pan/zoom engine 9 indicate when 
the data is ready. This delay is compensated for by stalling the graphics engine 10 pipeline until the read data 

20 is received. The graphics engine 10 reads the data from the monitor or workscreen 3 in the clock period after 
the read acknowledge handshake signal is received from the pan/zoom engine 98e 8, in order to be compatible 
with the one clock delay in the compositing memory 4. Latches, (not illustrated and external to the graphics 
engine as eariier described), hold the data during this delay. The workscreen memory 30 can also have a delay 
when writing pixel data. Typically, the first pixel written will not be delayed, as the write request is "posted", 

25 and performed in subsequent clock periods. The pan/zoom ratio must be set to 1 :1 for WS to WS compositing, 
as will be understood by those skilled in the art. 

CM to WS compositing Is used to transfer pixel data from the compositing memory 4 to the workscreen 
memory 30. During CM to WS compositing, a maximum of one pixel Is read and written in every pixel clock 
period. Reads are requested from the compositing menvDry 4 in the first half of the pixel clock period. Writes 

30 are requested from the workscreen memory 30 during the entire pixel clock period, but the address and data 
are only available in the second half of the pixel clock period. Separate addresses are maintained for the work- 
screen address and the compositing memory 4 address. 

Due to timing constraints in the compositing memory 3, there is a one pixel clock period delay between 
issuing a read address, and reading the data at that address. This delay is compensated for by adjusting the 

35 position within the graphics engine 10 pipeline where the read data is received. Due to timing constraints in 
the workscreen memory 30, there can be a delay between issuing the write request, and receiving the corre- 
sponding handshake signal from the pan/zoom engine 9 which indicates when the data has been accepted. 
This delay is compensated for by stalling the graphics engine pipeline until the handshake is received. The write 
address and data will be presented again in the second half of the next clock period until the handshake is 

40 received. Typically, the first pixel written will not be delayed, as the write request is posted, and perfonmed in 
subsequent clock periods. 

CM to WS compositing can be used in conjunction with a reduction zoom ratio to reduce the size of the 
workscreen image. In a reduction mode, the pan/zoom engine 9 discards pixels from the graphics engine 10, 
and only writes every "NTH" pixel. This is transparent to the operation of the graphics engine 10, as the only 

45 difference it perceives is that writes appear to be completed quicker. 

CM to WS compositing can also be used in conjunction with a magnification zoom ratio to Increase the 
size of the workscreen image. In expansion nnode, the pan/zoom engine 9 reads a pbcel from the graphics engine 
10, and writes the next "N x N" pixels with the same value. This is also transparent to the operation of the 
graphics engine 10. as the only perceived difference is that writes appear to take longer to complete. Note that 

50 only the first pixel address in a run is used by the pan/zoom engine 9. The graphics engine 1 0 generates addres- 
ses for subsequent pixels, but those addresses are not required by the current implementation of the pan/zoom 
engine 9. 

WS to CM compositing is used to transfer pixel data from the workscreen menrrary 30 to the compositing 
memory 4, During WS to CM compositing, a maximum of one pixel is read and written in every pixel clock period. 
55 Reads are requested from the workscreen memory 30 In the first half of the pixel clock period and writes are 
perfonmed on the compositing memory 4 In the second half of the pixel clock period. If the workscreen read 
has not been acknowledged by the end of the pixel clock period, the pipeline will be stalled. The read request 
will remain pending, and the write to the compositing memory 4 will be repeated at the same address. Separate 
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addresses are maintained for the workscreen memory 30 addresses and the compositing memory 4 addressee 

Due to timing constraints in the workscreen memory 30. there can be a delav h^^lTn > 
request, and reading the data at that address. Again, handshake ^onSs from thVn J ? '""'"^ ^ '^^"^ 

when the data is ready. This delay is compensated st^ the g^p^i j f '^.^^^^^^^ Tn""' •? 
data is received. The compositing memory 4 has a one'docrde ay when S^^Z Je o^^^^^^ I!" ' ^ 
not affect the initial operation of the graphics engine 10.' ^ ^ ^'^ 

WS to CM compositing can be used in conjunction with a reduction ratio to increase th<. «f *k ■ 
as It is copied into the compositing memory 4. In this mode tTiT^oom enoTS?^. . ^ '""^^^ 

address dunng the first pixel in a run. but onTy incremenrthS fddraJ^ aft^ev^rN" ^^^^^^^^^^^^^^ rLTet^m" 
the graphics engine 10. This has the effect of expanding each pixel but is tranLrent to thl «n ^ 

graphicsengine10.No.ethatonlythefirstpixel address inarunisuLbTthlr^^^^^ 
engmejogeneratesaddresses for subs 

« engi^eV" '''' "^'^ ^ -P^--" ^-"^ -tic in the pan/zoom 

^^^^ 

A Load Graphics Engine (GE) Salt Configuration command allows various modes to be set within fh» 
red"^"L^»r[r^'' °' parameter following the load GE configuration instrtiction configure the "matte to 

ircis^sr~^^^^^^^^ 

. ~VP.ca,ly.the»altmicrocod;~ 

commrnd.Sl:;'^gf3r.^S^S^^^^^^^ later described, cannot be loaded using the load register 
The graphics plellne Ses these Sgi^i^^^ texture offset" registers, however, can be loaded. 

e=. inese registers instead of the usual registers when the "execute microcode- instruc- 
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tion is executed. Table 5 provides a description of various registers provided within the graphics engine 10. 

Synchronisation commands are used to maintain the graphics engine 1 0 synchronised to internal and exter- 
nal hardware events. There are two synchronisation commands, namely no operation (NOP) and WAIT. 

The NOP instruction has no effect upon the graphics pipeline other than to consume one word and one 
clock cycle. It is intended to be used at the end of an instruction stream so that the length of the stream is a 
multiple of four 32-bit words. This ensures that the DMA controller, provided on bus 14 in Fig. 2. and which 
transfers data in four word bursts, will always send the last command. 

The WAIT instruction prevents the graphics engine 10 from executing new instructions until one of three 
events occur. Those events are: a hardware restart signal is received, a software restart is received, or the 
graphics pipeline becomes empty. Options to the instructions select which of the events will restart instruction 
execution. Pixels from the previous instruction which are still in the graphics pipeline, are not effected by this 
Instnjction. 

The hardware restart option allows the graphics engine 10 instruction execution to be synchronised to 
extemal Veal-time" events. This is required when performing a *'test scan" where the graphics engine 1 0 is used 
to copy an image from the compositing memory 4 to the workscreen 3, while the scanner 6 is writing to the 
page memory 4 simultaneously. The graphics engine 10 and the scanner 6 operate on opposite halves of the 
page memory 4. and swap over every eight lines. The instruction stream presented to the graphics engine 10 
is separated into multiple strips of eight lines. A single WAIT instruction is inserted between the compositing 
commands for each strip. This forces the graphics engine 10 to wait for the scanner to "catch-up" before pro- 
ceeding to the next step. 

A software restart option allows the computer 1 to be synchronised to the graphics engine 10 instruction 
execution. If the computer 1 needs to perfonm certain tasks between groups of graphics instructions, a WAIT 
instruction can be inserted between the groups. When the graphics engine 10 reaches the WAIT, an interrupt 
is optionally generated, and the execution of the new instructions is suspended until the computer 1 writes to 
a CONTROL register with the RESTART bit set. as will be discussed later. 

The pipeline empty restart option allows the graphics engine 10 to wait-until the previoi>s instruction is fully 
completed before starting a new instruction. This instruction is generally not required in normal operatton. It is 
only required if a design error allowed neighbouring i instructions to effect each other. Table 6 shows the bit 
relationship of the WAIT instnjction. 

In addition to registers provided for the DMA bus 14 in Fig. 2. registers are also available for the computer 
1 to interface with the graphics engine 10. Table 7 lists internal registers of the graphics engine 10 showing 
the relative address, size and whether the respective address is readable or writable. The COMMAND register 
provides an alternate mechanism for writing graphics commands to the graphics engine 1 0. Writing to the COM- 
MAND register places the input data on the top of a FIFO 150 within the RP interface 100, and is effectively 
the same as writing via the DMA bus 14. The status of the FIFO 150 should be read from the STATUS register 
before writing to the-COMMAND register, to ensure that the FIFO 150 is not full. Writing graphics commands 
via the COMMAND register is relatively slow, as it is not expected to be used in normal operation. It does, how- 
ever, provide a means of "single stepping" the graphics engine 10 for debugging and self test purposes. The 
FIFO 150 can also be written one word at a time. The control unit 300. however does not read the FIFO 150 
until it contains at least four words. Table 8 shows the anrangement of the comnriand register. 

The CONTROL register is used for setting intenrupt , masks, clearing interrupts, and enabling various test 
modes, and includes a bit configuration as shown in Table 9. 

The HIE bit is the hardware interrupt enable. If set to a 1. the computer 1 will receive an interrupt when the 
graphics engine 10 receives a WAIT command when the "hardware restart" option is enabled. This interrupt 
is cleared by writing a 1 to the CHI bit (even if the graphics engine 10 is stopped). The setting of the HIE bit 
can be read from the STATUS register. 

The EIE bit is the "ERROR" interrupt enable. If set to a 1, the computer 1 will receive an intemjpt when 
the graphics engine 1 0 detects an error condition. This interrupt is cleared by writing a 1 to the CEI bit, until a 
new en-or is detected. An error is detected if a hardware restart or a software restart is received when the 
graphics engine 10 is not in the STOPPED state. In the case of a hardware restart, this indicates a loss of 
synchronisation with the external real time event The current setting of the EIE bit can be read from the STATUS 
register. 

The RST bit is used to restart the graphics pipeline. When this bit changes from a 0 to a 1, the graphics 
pipeline is restarted. 

The SWR bit is used to generate a software reset. When set to a 1. the entire graphics engine 10 is reset 
to the power on reset condition. The SWR bit does not need to be cleared by a programmer, as the CONTROL 
register is also reset. 

The SEE bit is the "stop on error" enable. If set to a 1. the graphics engine 10 will enter the STOPPED 
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condition if an error is detected. 

Six bits designated TMn are used to enable test modes in blocks within the graphics engine 10 TMO is 
used to put the run length counter 220 into a test mode as will be discussed later. TM1 is used to out oaae and 
screen address counters, within the address generator 800 into a test mode, as win I.Lo be discusled'ater 

The STATUS reg^ter .s used to monitor the interrupt nags and the FIFO 150 status, to read the version 
number, and to read the status of the various test modules. Table 9 shows the configurati;n of the status reg" 

<;iF ?nH PIP '''f r"^'^' °^ 'f'^ '"'«^Pt "lasks set in the CONTROL register. The HIF 

T;::^,^:^::^ " ''^^^ "^^^ ^^'^ --P-^--^ i-ter^Pt e^nable b« is set.' 

enaL^"hrb^ttrXw^^^^^^ 

Pn»h^^ ^Th-'' k'V^ ^'^'""'^ ^° '^""^'^^^ ^ ^^"^ command with the "software restart" option 

enable. Ths bit is cleared by writing a 1 to the CSI bit in the CONTROL register 

in thlcONTRO^rlgistr" ^" ^"""^ ™^ '"^^^^^ "'^^'"^ ^"^'"9 ^ ^ ^° ''^^ 

ZI]^ '''^ '"^'eating that the COMMAND register should not be written 

150 1 n\?Lnt!f.? k" ''f 9'^^^'^ ^"^'"^ ' ° """"'"9- '^"""'"Q ^^''"^'^ -"ot waiting and the FIFO 
150 IS not empty . (i.e. when the graphics engine 10 is executing an instruction) 

PiPo i!n° t! "li ^ controller, with the RP controller 120. detects an overrun condition in the 

FFO 150. The TSn bits reflect the level of a number of Internal modes which are used during testing by the 
device manufactirer during manufacture of the graphics engine 10 using LSI technology. The Vn bits coma in 
the version number of the integrated circuit (LSI) chip. contain 
The graphics engine 10 inputs and outputs can be classified into four categories- 
25 1. Interface signals with the computer 1. and in the preferred embodiment, the computer Is an i960 pro- 

cessor operating at 33MHz.- h' " 

2. Page memory 4 interface signals; 

3. pan/zoom interface signals; and 

4. other interconnect signals. 
30 Table 1 0 provides a list of each of these signals. 

The computer 1 (i960) can access the graphics engine 10 in three ways, either by DMA writes register 

the computer 1 at high speed. Register writes are used to configure the graphics engine 10. and register reads 
35 deL^g moder""**' °' '"^ ^"""'"^ '"^'"^ ""^^'"'^^ ""^ ^'^^^ used inTesT^^d 

d.nr^So^^'h DMA accesses are required in order to transfer large images to the graphics engine 10 without 

Th '^^"secutive 32-bit words from the DMA controller of the computer 1 in a single DMA 

ThT K of transfer ,s known as a "quad word burst flyby" DMA transfer. A DMA request is issued by 

the cZm'SrT^'T " '^^^^ 32-bit words. The DMA controller of 

the computer 1 subsequently acknowledges the request and writes four 32-bit words of data in a single burst 

rImwI ? Tnr^u^*^ ""^ detemiined by the access time of the memory (usually dynamic 

cTnni^t " nT"' ' ^'^''^"^ determined by the available bandwidti of the bus inte ! 

connecting the computer 1 and graphics engine 10). If no other DMA channels are operating, the graphics 

clortTi;? TK^ f T '° ^'^"^''^ ^"^'"^ ° ^PP'O'^i'^ately 432-bit words every 26 processo 
whTn^gVet^r^c'ir'^'^^^^^ 

so and ~e~catrbyTersV3t^^^^^^^ ^^^^^^^ ^ ^^^^''^ 

h.nT^ HfL" ^'^P^'*^ ^"9*"® ^° ^"^ compositing page memory 4 preferably has a 
oeriod ?7S ■"'""'^"^ per second. One 32-bit pixel is read and written in every pixel dock 

?he dat^hl^iP H ^^T-^"""^^ fi-^t half of the pixel dock periods, and writes in the second hJf 
55 S?btt«;^ "^"^ ^^^^ P*^^' Sin<=e the width of the data bus 19 is high 

55 (32 bits) care must be taken to ensure that there is no contention between the graphics engine 1 0 and the com- 
posi^ng memory q when the bus 19 is changed from input to output, and output to input 

.nn^^^-^T^T'"^ ^'^"'^ "^'P^ ^" "'"e °f 25 ns. In order to relax timing 

constraints on the graphics engine 1 0. a one clock delay is inserted between issuing a read address, and read- 
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ing the data at that address. This delay is compensated for by adjusting the position within the graphics pipeline 
of the engine 10 at which the data is accepted. 

^ Furthermore, in order to relax timing constraints on the graphics engine 10, a one clock delay Is Inserted 
between issuing a write, and when the write is actually performed. This delay Is transparent to the operation 

5 of the graphics engine 10. 

The Interface between the graphics engine 10 and the workscreen 3 uses the same address and data bus 
as used to read and write to the compositing memory 4. The workscreen memory 30 Is shared between an S 
Bus device, display refresh, and reads and writes from the graphics engine 10 via the pan/zoom engine 9. As 
a result, there Is a delay between Issuing a read request, and reading the data at that address. Handshake 

10 signals from the pan/zoom engine 9 indicate when the data is ready. This delay is accounted for by stalling the 
pipeline of the graphics engine 10 until the read data Is received. The workscreen memory 30 can also have 
a delay when writing pixel data. Typically, the first pixel written will not be delayed, as the write request is posted, 
and perfonmed In subsequent clock periods. 

The preferred hardware implementation of the graphics engine 10 can now be described having introduced 

15 various control functions that the graphics engine 10 provides. Not all hardware components are described In 
detail as some perform functions that are readily Identifiable from their name and hence are readily understood 
by those skilled in the art. 

Unless otherwise stated, all latches and flipflops to be referred to use the main pixel clock signal PXCLK 
(operating at 13.35 megahertz). Enable signals do not clock these devices directly, or gate the clock, but simply 
20 select new data via a front end multiplexer which would otherwise recirculate old data. The various modules 
of Fig. 2 can now be described. 

The render processor interface 100 of Fig. 3 is responsible for controlling and monitoring the status of the 
graphics pipeline of the engine 1 0 from the computer 1 which is preferably an i960 processor. All control signals 
between the graphics engine 10 and the computer 1 are synchronous to the computer clock HCLK. The RP 
25 interface 100 resynchronises the signals to the pixel clock (PXCLK) which Is used by the remainder of the 
graphics engine 10. The RP interface 100 is divided Into a control block 120 and a first-ln-first-oul shift register 
(FIFO) 150. 

The RP controller 120 is not shown in detail but generally includes an address decoder, a control register, 
a status register, an interrupt controller and a DMA controller. The address decoder generates register select 

30 signals for the control register, the status register and the command register. The control register, when selected 
by the address decoder is loaded with data from the computer 1 which is used to configure the interrupt, 
synchronisation, and test modes as earlier defined. The control register contains resynchronisation flip-flops 
to synchronise to the pixel clock PXCLK. The status register allows the computer 1 to monitor interrupt flags, 
the status of the FIFO 150, and other internal conditions as defined earlier. The status register also contains 

35 circuitry to regenerate synchronised reset signals and status outputs. The interrupt controller combines Interrupt 
flags from the status register where the Interrupt enables from the control register to produce the output INT of 
i the interface 100. The DMA controller generates a DMA request when ROOM__44, seen In Fig. 3, indicates 
that the FIFO 150 has room for four more words from the computer 1 . When the computer 1 grants a DMA cycle 
via the DACK signal, a new word is written into the FIFO 150 in each processor clock period where NEXT is 

40 asserted. If a DMA acknowledge Is received when a DMA cycle has not been requested, an error condition is 
generated. A WRITEFF signal Is asserted for each valid DMA word. 

The FIFO 150 as seen in Fig. 4 uses an eight word 32 bit dual port RAM 170 to interface the computer 1 
with the pixel pipeline within the engine 10. A write address generator 155, synchronised to the process er clock 
PLCK interfaces the computer 1 to the RAM 1 70. A read address generator 1 60. synchronised to the pixel clock 

45 PXCLK interfaces the RAM 170 to the pixel pipeline. Handshake signals between the two address generators 
are synchronised in each of their respective receiving circuits. 

The write address generator 155 operates synchronously with the i processor clock PCLK to produce an 
address and a write pulse to the RAM 170. The generator 155 also generates a signal to indicate when there 
is room for four more words, and two signals to Indicate when the two halves of the FIFO 150 contain valid 

50 data. The FFMT output provides an indication to the computer 1 via the status register of the RP Controller 
120 that the COMMAND register should not be written. 

The generator 1 55 is implemented with a three-bit counter which is reset to 0 when the RP_RESET signal 
is asserted. The counter increments when the WRITE_FF signal Is asserted. 

The read address generator 160 operates synchronously with the pixel clock PXCLK to produce an address 

55 to the RAM 170. The generator 160 provides a signal to indicate when the FIFO 150 Is empty and two signals 
to Indicate when the two halves of the FIFO 150 have been read. The generator 160 is implemented with a 
four-bit state machine which is Initialized when the PX_RESET signal Is asserted. 

Fig. 5 shows a state transition diagram which fliustrates how the address and the "empty" signal (MT) are 
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generated within the read address generator 160 

instmction decoder 350. The instrucrn ^S^;" 3^^^^^^^^^^^ 

s the registers 305 and 310 in accordance wiS the command receive " t^^^^ 

nstr^ction register 310 to produce a status word which is passed toihe graphics pi^eS^ ^CODE" 
instmction is detected, the normal instruction decode is bypassed bv the data in thrr.!:^ ^ EX UCODE 
This code is used for test and debug purposes. ^ ^ micro-code register 305. 

The construction and operation of the instruction interpreter 320 and instruction dPrnrt«r ■»<;n m •> 

10 rent to those skilled in the development of applications specific microcrntrere a^D^Lini . 1 f 
ment of each new microcontroller, a new or modified instruaior^^rml^/^^^^^^^^ 

data, must involve the interpretation and decoding of various commits ^«^<1'"9 

The run controller 200. seen in Fig. 7. interconnects the RP interface 100 with the data natt, inH,.H- • . 
polators 400 and compositors 500. The run controller 200 perfomis two t^slS^throurh th^n.n!! . ^ 
IS polation ramp, and to indicate when the last pixel in a mn is Zg^ompo^ted pe^^^^^^ 

IS required that the mn controller 200 be loaded with the run tenafh aTart nti.P^^ I^h . ! ^""^1'°"=. -t 

ROM 260 whrch compnses a lookup table outputting a value corresponding to 255/(RL- ) M I^T^ Jll 
When ,n the jump mode, the output value from the ROM 260 is added to the accumulator 292 which is 
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initialized to zero by the START signal. The most significant bits of the accumulator form the rannp output as 
can be seen from Fig, 1 0. 

When in the step mode, the generator 250 applies an algorithm similar to Bresenham's line drawing 
algorithm, which is known to those in the computer graphic arts. The accumulator 292 is initialized with the con- 
stant (511 - RL), and the ramp counter is initialized to zero. In subsequent clocks, one of two constants are 
added to the accumulator:- 510 if the accumulator is negative, or, (512 -'2RL) if the accumulator is positive. 
The ramp counter (flip flop 294) is incremented on every clock where the accumulator 292 is positive. Note 
that thestep mode requires the multiplexer 254 to bypass the latch 252 during the START cycle. This allows 
the new value In the CONSTI module 265 to be loaded into the accumulator 292 in the START cycle. The mul- 
tiplexers 280 and 282 are shown in Fig. 10 for clarity only. A simpler implementation for the multiplexer 280 is 
a string of AND gates. Similarly, the multiplexer 282 can be implemented as a string of OR gate for the nine 
least significant bits, and a string of AND gates for the most significant bits. 

The colour component data path of the graphic engine 10 consists of three eight-bit data paths. Each eight- 
bit path contains an interpolator 400, which also performs colour correction, and a compositor 500. The red, 
green and blue interpolators are identical. The three compositors, however, are slightly different. The green 
compositor is used by the matte channel in some instructions and the resulting differences in the green channel 
are described later in this specification. The colour interpolators 400 comprise three modules: a synchronisation 
module 41 0, an interpolation phase A 420, and an interpolation phase B 450, The synchronisation module 410 
spans stages 0 and 1 of the graphics pipeline and holds operands for the cunrent instruction, and instruction 
operands for the next instruction. The interpolation phases A and B (420 and 450) perform blends and colour 
correction. The two phases are required in order to maintain one pixel per clock cycle. Phase A (420) is in stage 
2 of the pipeline, and phase B (450) is in stage 3. 

The synchronisation module 410 is not shown in detail but however comprises latches and flipflops which 
provide the start colour, the end colour and the pixel value. 

The interpolation phase A 420 is shown in Fig. 13 and performs two types of calculations, either blends, 
or colour correctiono. Those skilled in the art will appreciate that colour runs are simply a degenerate case of 
a blend when the start and end colours are the same. The phase A Interpolator 420 performs calculations for 
the first part of both types, namely 

for blends, C_MULT = (END-START)* RAMP 7256 
for colour con-ection, C_MULT = (END*PIXELy256). 

The interpolator phase A420 comprises a summer 4Z2 which subtracts the START value from the END 
value. The multiplexers 424 and 426 change the inputs to the multiplier 430 respectively. For blend commands, 
the summer 422 has a nine-bit two's complement output which is fed to the multiplier 430. For colour con-ection 
commands, the END value (which also corresponds to the CONTRAST) is fed to the multiplier 430 when the 
sign bit is set positive. In blend commands, the second input of the multiplier 430 comes from the ramp generator 
250 of Fig. 1 0 and has the effect of controlling the mixing proportion. In colour correction commands, the second 
input of the multiplier 430 comes from the commands pixel string. A new pixel to be colour corrected is loaded 
every non-stalled clock period. Only the top nine bits and the sign of the multiplier output are required. The 
output is a 10-bit two's complement number. Rounding is not performed as a one least significant bit error is 
considered acceptable. 

The START_D output contains a delayed version of the START value for the next phase of the interpolator. 
In colour correction mode, the START value is equivalent to the BRIGHTNESS. 

Phase B 450 of the interpolator 400 performs the second part of both of the blends, and colour conrection 
calculations, namely 

for blends, D_OUT = C.MULT + START_D = ((END-START) ♦RAMP/256) + START 
for colour con-ection. D_OUT = (C_MULT*2) + START_D = ((EN D_START)* RAMP/1 28) + START 
It should be noted that rounding enrors introduced by the multiplier 430 of phase A 420 lead to an enror of 
one in the final value of the- blend. That is 

for END-START>0, D_OUT(FINAL) = END-1 
for END-START>0. D_OUT(FINAL) = END + 1. 
The phase B circuit 450 comprises two multiplexers 452 and 454 both supplying a summer 458, The sum- 
mer 458 supplies a limiter 460 which, in turn, supplies the output via a latch 462. The multiplexer 452 changes 
the inputs to the adder 458 to perform the multiplication by 2 for the colour correction function. The most sig- 
nificant bits pass straight through to the adder 458, For blend commands, this has the effect of signextending 
bit 8 by one position. 

The multiplexer 454 adds an extra two inputs to the adder 458 to perform a sign-extension for the colour 
conrection function, which uses a 8-bit signed format for the BRIGHTNESS. For blend commands, these two 
bits are set to 0, as the START value is unsigned. The adder 458 sums the two 10-bit signed numbers output 
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15 



20 



from the multiplexes 452 and 454 to produce a 10-hif ^innoH ro«=..!f ^r.^ ^ ^ - 

J. . Kiv/uui^c; d lu-Dii Signed result, and a positive overflow md cafnr a 

negat-ve overflow .s not possible in either blend or colour correction modes. In blend He thrsTartC^^^^ ^ 

always positive, and m colour correction mode, the MULT value is always positive 

The adder 458 output is passed to the Iimiter460 which is used to saturate values qreater than 255 to 

n . . ^ M 460 has no effect in run or blend commands as the adder 

Iru T .^ "V" ' V^"'^ ° - ■'''^ fr"-" '^^^ "'""^^ 460 is latched (462)Tn ever^ nrntsSfed 

clock penod. in readiness for the next pipeline stage. ^ non-staiied 

TK I" ° "°' configuration can be readily derived from the above description 

10 The hmiter 460 has an input bus range from -128 to +638 description. 

and 560 perform a blend between the original value in the external memory, and the new v^ue from tL lr' 
^spending interpolator 400. The proportion between original and new is coritrol.ed by "e ^L^nS bus whTch 
^cTe nh.,^ '"atte combiner 700. Two phases are again required in order to maiLin one pixef per do^ 
cycle phase. Phase A540 is in stage 5 of the graphics pipeline and phase B 560 is in stage 6 The matte 
tiplexer 580 allows the data from the matte channel to be output on one or more o Je cStouV pSnTs Th^^ 

f^::T:rthr^:„?rbir ^^^^ ° '-^ - « - - 

The synchronisation module 520 is not shown in detail as it merelv latchpc: n^t^ fr^rv, ^vf^^ , 
one'r: '"^'T ^^"'^^^ P^-« A unit 540.'lhrsX"sTgra.tXedTt:is^^^^^^^^ 

Phase A 540 of the compositor 500. seen in Fig. 16. performs the following calculation- 

C_MULT = (C_ORIG - C_NEW)« BLEND/256 
Phase A 540 includes a summer 542. a multiplier 546 and output latches 548 and S-iO All ^nr»„=.„w 
the same forn^at with 8-bit unsigned, values on each of the NEW ORIG and WlEND fnn^if^ th 1 . 
30 the adder 542. which, having an inverted input functions as a subtracter' fs f J hftT , 
Which is fed to the multiplier 546. The second ■^^.T:>i:Z^^^^^^ 

the top 8 bits and the sign of the multiplier 456 output are required. The output is a 9 bit 31 nn^^nf ' , 

^ie r560°o"f^r^^^^ ''^ ^"'^ ^^'"^ "^'^^ P'^-^ <^«°) ^-^^ comp'os tor 500 

Phase B 560 ^/j^^^^^^j; °;500 IS s^^^^^ in Fig. 17 and performs the following calculation: 

M . D_MULT = C_MULT + C_NEW_D = ((0RIG-NEW).BLEND/256) + C NEW 

fnr nnn ^"""^ introduced by the multiplier 546.in phase A 540 lead to an error of at least one 

for non-opaque compositing. For example: 
■« when ORIG-NEW>0. 

D_OUT (fully transparent) = ORIG-1. 
when ORIG-NEW<0, 
D_OUT (fully transparent) = ORIG+1. 
Fully opaque compositing will always produce the exact NEW value That i^- 
45 D_OUT(fully opaque)=NEW. a'ue. mat is. 

A wirh'the%\?.m«''"''r T '"'"^ ^'9"^'^ ""'""^^ fr^-" 'he multiplier S46 in phase 

Thelnoe 0 to as *1 ' ' Inn^^'^ '"'^ P*'^^^ ^ 540. The Lult is 2ays n 

o,LS^ h L ^^^'^"'^Po^'to^ 500 can only produce numbers between the ORIG and NEW values The 

so s^atofCfp^lt^^^^^^ 

700 ^T^atl7£^2V^l^!l7^ ■ " r''- ' '°'"r ' transparency Interpolator 600 and a matte combiner 
Leen a S?ART fnd END^^^^ T"^' '"""^ ^^"^'^'^ ^ transparency blend by interpolating be- 

Th! f I transparency, and to combine the transparency blend with the matte plane 

ss rnodlle 6^ riS^^^^^^^^^ T^" ^^^'^^ '^^^^ '""'^"'^^ '"^'"'^'"^ ^ syS~on 

=r=rha:~^^^ 

.quiredin:^;^^^^^^^^^^^^^^ 



13 



&VSDOCID: <EP 0465250A2_I_> 



EP 0 465 250 A2 



stage 3. 

Fig. 19 shows the various components within the synchronisation module 610. Latches 612 and 614 hold 
the START and END transparency parameters for the next instruction. This conresponds to stage 0 of the 
pipeline. Flip flops-620 and 622 load these values when the START signal indicates the first pixel of a new 
instruction is In progress. A third latch-616 holds the texture start parameter for the next instruction. This is a 
2-bit parameter which determines the byte offset into the initial texture word for texture run and blend com- 
mands. It Is loaded into a third flip-flop 624 via a next offset module 618 when the START signal indicates the 
first pixel of an new instruction is in progress. A fourth flip-flop 626 holds the texture for up to four pixels in texture 
run and blend commands. The flip-flop 626 is loaded from the data bus D_IN in every fourth non-stalled clock 
period. A fifth flip-flop 628 holds the transparency for each pixel value in pixel string commands, and is loaded 
from the data bus in every non-stalled clock period. 

The next offset module 618 is used to control the texture byte offset, and the texture word flip-flop 626. For 
texture run and blend commands, the texture byte offset is Initialised when the START signal is asserted, and 
counts by one in other non-stalled clock periods. When the offset equals 3. the LASTT signal is asserted! The 
texture word flip-flop 626 enable signal is also asserted at this time as well as during the start cycle 

Phase A 640 of the interpolator 600 is shown in Fig. 20 and performs the following calculation: 

T_MULT = (T_END-T_START)*RAMP/256. 

Phase A 640 includes a summer 642 configured to subtract two input data bytes. The output of the summer 
642 is a 9-bit two's complement output which is fed to a multiplier 644. The second input of the multiplier 644 
comes from the ramp generator 150 of Fig. 10 and has the effect of controlling the mixing proportion between 
the start and end values. Only the top eight bits and the sign of the multiplier 644 output are required. The output 
is a 9-bit two's complement number. Again, rounding is not perfonmed as one least significant bit error is con- 
sidered acceptable. Phase A 640 also has a T_START_D output which contains a delayed version of the 
T_START value provided by a latch 652 for the next phase of the interpolator 600. A multiplexer 646 uses the 
T_OFF signal from the synchroniser 61 0 to select one of the four texture bytes in the T_PIXELS input. In texture 
run and blend commands, a different byte is selected in each pixel clock PXCLK period. In pixel string com- 
mands, the transparency is selected from the T_PIXELS input via a second multiplexer 648. The texture is 
latched (654) to maintain synchronisation with pipeline stage 2. 

Phase B 670 of the interpolator 600 is shown in fig. 21 and performs the second part of blend calculations, 
namely: 

TR_OUT = T_MULT + T_START_D = (r_END-T_START)* RAMP/256 + T-START. 
Note that rounding enters introduced by the multiplier 644 in phase A 640 lead to an error of one in the final 
value of a blend. That is: 

for T_END-T_START>O.TR_OUT(FINAL) = T-END-1 
for T_END-T_START<0,TR_OUT(FINAL) = T_END + I 
In Fig. 21, an adder 672 sums the 9-brt signed 

value from the multiplier 644 in Fig. 20 with the 8-bit start value. The result is always a positive 8-bit value 
since it must be in the range T_START ... T_END, A multiplexer 676 selects the output of the adder 672 for 
run or blend commands, or the texture byte for other commands. In bitmap commands, and commands which 
do not have subsequent words, the opaque signal is asserted. This has the effect of forcing the texture to 25S 
(opaque). 

The output firom the multiplexer 676 is latched (678) in every non-stalled clock period, in readiness for the 
next pipeline stage. The transparency value from the output of the "opaqueing" module is also latched (680) 
and passed separately to the matte combiner 700. The matte combiner 700 uses this value when the "matte 
source = subsequent" option is specified by the instruction set. 

The matte combiner 700 is shown in Fig. 22 having four modules including a synchronisation module 710. 
a matte calculator 730. a matte delay 720, and a green multiplexer 790. 

The synchronisation module 710 is in stage 4 of the pipeline. It latches the matte plane of the RGBM data 
from the extemal compositing 4 or workscreen 30 memory in the first half of the pixel clock period. Based on 
this value and the transparency from the transparency interpolator 600. the matte calculator 730 produces a 
blend value for the colour compositors 500. and a new matte value for the compositing memory 28. Matte cal- 
culations are perfomned in stage 4 of the pipeline. The delay 720 passes the matte value unchanged to the 
green multiplexer 790 to synchronise with the colour components which are calculated in stages 5 and 6. The 
green multiplexer 790 allows the data from the green channel (400, 500: Fig. 2) to be output on the matte plane 
of the compositing memory 4. This is performed in stage 7 of the pipeline. 

Fig. 23 shows the components within the matte synchronisation module 710. A latch 712 produces a 
delayed version of the STALL signal to compensate for the one clock delay in the compositing memory 28. The 
input data from the external memory is asynchronous to the main intemal pbcel clock PXCLK. It is, however. 
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synchronous to the CLK 2 signal which is used to derive the pixel clock via a NAND gate 714 so the phase is 
fixed. This data is latched (716) in the first half of the pipeline stage 4 9 e / 1*. so tne phase is 

The matte calculator 730 is seen in Fig. 25 and performs two calculations: 

BLEND = LIMIT (TRJN-M_SYNCD) 
M_OUT = LIMIT (M SYNCD-TR IN) 
where LIMIT (a-b) = 0, if a - b < 0 ~ ~ 

Both the TRJN and the M_SYNCD inputs are 8-bit unsigned values. The comoonents in thP ton h.ir of 
F^^ 25 calculate the BLEND output which is used to control Ihe mixing proportS^n in ,he c^^^^^^^^^^ 

represents fully opaque compositing. The BLEND value is calculated by subsfracting usina an adder y^T^hl' 
matte data in the compositing (or woricscreen) memory 28 from the transparencyThL has e^th^ f ' „ InW 

the adder 734 A multiplexer 742 can bypass this calculation and select thL input trtspa^ency ff^e T 
NUS M input IS no asserted (the T_MINUS_M signal is decoded from the command wort in the con ^'u^ » 
300.)Tocompensateforthedifferentinputandoutputsense Of thetransparency.the multiplexer 7^^^^^^^ 
S is aL^rted " ^ 75^:^^' T ,2 

The components in the bottom half of Fig. 25 calculate the M OUT output which is written into th*. maH» 
plane. This value is calculated by subtracting, using an adder 736.1he transpail^ fmrn^e "3^^^^^^^^ ^^J^ 
Z7rT^. ""'^^r^") •"^'"^^ ^'3°- A ft^rther limiter 740 saturates this value to 0 ^tTe r^s^isTgative 
the mput transparency if the M_MINUS_T Input is not asserted. A further multipJexer 748 selectft^e SUBs T 

lathi / ""T °' ^"^^^'"^^ "subsequent Both the BLEND M OU? VALuS^lI 

latched to synchronise to stage 4 of the pipeline; v«i-uto are 

The matte delay 720, seen in Fig. 24. passes the matte value unchanged to the green multiplexer 790 to 
synchronise with the components which are calculated in stage 5 and 6. A flip-flop 722 sync^^es to s'aoe 
5, and a second flip-fIop-754 synchronises to stage 6 J' =.yncnronises to stage 

^rZntr'"''"^^^ °' ^ ^^^PO^sible for providing read and write addresses for the 

compositing memory 4 and the workscreen memory 30. A read cycle and a write cycle are perfon^ed in e^ch 
30 p.xe clock period. Compositing memory 4 addresses are provided by a page - address generator within th^ 
address generator 800. and wori<screen addresses are provided by a screen address generator I so within 
generator aOOJhe address generator 800 operates in a manner known to those sk lledTnThe a^^^^ 

SSrT'ltt'"' "°'^^'=""" compositing memories. Having selected the pp^pS 

address either the page or screen addresses are multiplexed as detemiined by read and write siqnaTs The 

ZZ%^::7J::. ^ "^^^ ^^'^^ ^ •^^-^^--'^ delays trough the^o^rnd t Jnt 

The write controller 900 of Fig. 2 perfomis three main tasks, namely 

1. To implement additional functionality required for "bitmap mode" instructions- 

2. To provide appropriate pipeline delays of write control and other status inforriiation- and 
ilJ^TllT '° ^^•^^^^"'•"g •^«'"°0' 28 and the pan/zoom engine 9 handshake signals. 

.nd « h!.! . % f ' ''^ '^'■•^ known to those skilled in the art 

Zn JT ^^^'^T""" " '^""''"'^ specification. Essentially, the write controller 900 indudel three 
3?Nt wnT""" H f " '"'^y- ""'^ ^" bit map mode instn/cttons a s ng'e 

aoilTate n w r "'^ *° ^2 consecutive pixels. The status delay mcTde pro "des 

to SlZ lh^'^^'"^ T °' "^'^ ^"'^ "^'^^^ ^'^'"^ infomiaUon. It also contains a block which s used 

;:or:sr9^:nTshtreS^^^^^^^^ 

achii:e%Srtlktor^M:^^^^^^^^^^ -^'^^ ^ -P^'- -9ine 10 can be produced to 

tn mll!in.r»?'^®'^ embodiment of the graphics engine is able to implement a wide range of commands so as 

VAS P XELS cInvS TE;?tjTF^T^^^ ^^^^^^ ^^^^^^^ ^"^N^ SaS 

The CANVAS RUN 7^^*^^ f^UN and CANVAS TEXTURE BLEND will now be described. 

the tLnsparen^ and the m^^^^^^ ^ '^^ ^''^ compositing controlled by 

«wTi ? T ^'"^ command simulates the interaction of paint with .^nvas or other 

textured materials, as textured dents in the background progressively "fill up" with "painr TJ^e cTvas r^n c^.^ 

Address T^ f -LT °' ^"'^'^ °' ^ ^ ^^^^ ^'^^ colou . startTng Jthe pa^ 

marolane of'??"''^ compositing is controlled by the difference between the transparency mn andT 
matte plane of the image. The matte plane is changed to. be the difference between the matte value and the 
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run transparency. 

The operation is as follows for n=0 to Run_length-1 

RGB (image) [address+n] 
= ( (T (start) .Matte (image) [address+n] ) *RGB (start) 
+ (256- (T (start) -Matte (image) [address+n])) 
*RGB (image) [address+n] ) /256 

Matte (image) [address+n] 
= Matte (image) (address+n ]. T (start ) 

where . represents a subtraction operation with underflow limiting. 

The canvas run command is used for compositing object based constant colour "brush strokes" onto a text- 
ured background, where it is desirable to simulate the cumulative interaction between paint and a textured back- 
ground. To achieve this effect, the page matte should contain an Image which corresponds to the texture of 
the background. 

The CANVAS BLEND function composites a blend of colours with the image, with compositing controlled 
by the blend transparency and the matte plane. This command simulates the interaction of paint with canvas 
or other textured materials, as textured dents in the background progressively "fill up" with "paint". 

The canvas blend command composites the run length number of pixels of a colour smoothly changing 
from the start colour to the end colour with the image, starting at the page address. The Intensity of compositing 
is controlled by the difference between the blended transparency and the matte plane of the Image. The matte 
plane is changed to be the difference between the matte value and the blend transparency. 

The operation is as follows for n=0 to Run/length-1 
Interpolation [n] = n/ (Run__length-1) 
T[n] = Interpolation [n] *T (end) 

+ (1-lnterpolation [n] ) *T(start ) 
RGB[n] = Interpolation [n ] *RGB (end) 

+ (1-interpolation [n] ) *RGB (start) 
RGB (image) [address+n] 
{ (T[n] .Matte (image) [address+n] ) *RGB [n ] 
+ (256- (T [n] .Matte (image) [address+n] ) ) 

*RGB (image) [address+n] ) /256 

-/ 

Matte (image) [address+n] 
= Matte (image) [address+n] .T[n] 

where . represents a subtraction operation with underflow limiting. 

The canvas blend command Is used for compositing object based blended colour "brush strokes" onto a 
textured background, where it Is desirable to simulate the cumulative interaction between paint and a textured 
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o^The ^grl^nr"" '''''' '''' ^" "^^^^ "^''^'^ corresponds to the texture 

th. n^l;!i?'"^^'^^ PIXELS function composites a mn of pixels with the image, with compositing controlled by 
the pixel transparency and the matte plane. This command simulates the interaction of paint with canvas o^ 
other textured matenals. as textured dents in the background progressively "fill up" with "paint" 
n.nITJrT^%r^^ Command composites the run length number of pixels with the image, starting at the 
th« r ^"^f of compositing is controlled by the difference between the pixel Transparency and 

th: z:^^Ts;:zr'''- -"^"^ '^•^-^ ^^^-^^^ ^« ^^'^^ vaiu^ :n"d 

The operatior. is as follows for n=0 to Rur._ler>gth-1 

RGB (colour corrected) [n] 

•# 

= Limit ( (RGB (cor,trast)*RGB (pixel) [n],/256+ RGB(bright)) 

RGB (image) [address+n] 
= ((T (pixel) .Matte (image) [address+n]) 
*RGB (colour corrected) (n] 

+ (256- (T (pixel) .Matte (image) [address+n])) 
*RGB (image) [address+n] ) /256 
Matte (image) [address+n] 
= Matte (image) [address=n] .t (pixel) 

where . represents a subtraction operation with underflow limiting 

The canvas pixels command is used for compositing pixel based "brush strokes" onto a textured back 
a h^Tv^ 7^ I - d-irable to simulate cumulative Interaction between paint and a textured blckglnd To 
achieve th,s effect, the page matte should contain an image which corresponds to the texture of the background 

TrcTM^^ATTSTu;^^^^^^ ^ "-^^^ ^ '-^-^ ^-SZd.- 

^ .1 J^! '^^^^^^ TEXTURE RUN function composites a run of colours with the image, with comoositina con 
troNed by the texh^re and the matte plane. This command simulates the interaction of texturS bmsh strokes' 

^ ZZ'Zt '^^'^'^'r'^"^^-' '^^'='^9™-^ progressively "fill up" wUh "paint" 

startle aTthl nr '=°"^-^"^^^'""P°«'t«3 the run length number of pixels of a colour equal to the start colour" 
starting at the page address. The intensity of compositing is controlled by the difference between the i subse 

The operation is as follows for n,0 to Run_length-1 
RGB (image) [address+nj 

= ^^^^'^^"^^f"] -Matte (image) [address+n]) *RGB (start) 
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+ (256- (Texture [n] . Matte ( image) [address+n] ) ) 
*RGB (image) [address+n J ) /256 
Matte (image) [address+n] 
= Matte (image) [address+nj .Texture [n] 

where . represents a subtraction operation with underflow limiting. 

The canvas texture run command is used for compositing textured object based constant colour "brush 
strokes" onto a textured background, where it is desirable to simulate the cumulative interaction between paint 
and a textured background. To achieve this effect, the page matte should contain an image which corresponds 
to the texture of the background, and the subsequent texture bytes should contain a texture which relates to 
the texture of the paint medium. 

The CANVAS TEXTURE BLEND function composites a blend of colours with the image, with compositing 
controlled by the texture and the matte plane. This command simulates the interaction of textured brush strokes 
with canvas or other textured materials, as textured dents in the background progressively "fill up" with "paint". 

The canvas blend command composites the run length number of pixels of a colour smoothly changing 
from the start colour to the end colour with the image. The intensity of compositing is controlled by the difference 
between the subsequent texture bytes and the matte plane of the image. The transparency values of the start 
and. end colour are ignored. The matte plane Is changed to be the difference between the matte value and the 
texture bytes. 

The operation is as follows for n=0 to 
Blend_length-1 

Interpolation [n] = n/ (Run_length-1) 
RGB[n] - Interpolation [n] ARGB (end) 
+ (l-Interpolation[n] ) *RGB (start) 
RGB (image) [address+n] 

- ( (Texture [n] . Matte (image) [address+n] ) *RGb [n] 
+ (256- (Texture [n] .Matte (image) [address+n])) 
*RGB (image) [address+n] ) /256 

Matte (image) [address+n] 

- Matte (image) {address+n] .Texture [n] 

where . represents a subtraction operation with underflow limiting. 

The canvas texture blend command is used for compositing textured object based constant colour "Brush 
strokes" onto a textured background, where it is desirable to simulate the cumulative interaction between paint 
and a textured background. To achieve this effect, the page matte should contain an image which corresponds 
to the texture of the background, and the subsequent texture bytes should contain a texture which relates to 
the texture of the paint medium. 

It will be apparent to those skilled in the art that the above described functions result in the matte plane 
being changed by either the colour information (transparency) of the image or the texture information of the 
image. Subsequent manipulations are based on the changed matte plane. 

The foregoing describes only one embodiment of the present invention, and modifications, obvious to those 
skilled in the art can be made thereto without the party from the scope of the present invention. 
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For example, many of the individual buildinq blocks desmhaH .n^i. a , . ^ 
buffer data out of that respective unit. Those ^^hes are ^Jv ure^^^^^^^ >atch or latches which are used to 
synchronisation throughout the various pipeline stages throuoh the allh e-^bodiment to enable 

capable of operating at much higher speeds theTocS d,^^^^ -^'"^ ''"''''"'^'^ 

become insignificant and the re.Srement for he atTe^^ Ltng'^r::^^^^^^^^^^ ''""^^'^ 
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TABLE 5 



Reg tf NAME 



DESCRIPTION 
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0 ST_REO Start value of red component for run or -^1 end. Also used 

as red Brightness. 

1 ST_GREEN Start value of green component for run or blend. Also 

used as green Brightness. 

2 ST_BLUE Start value of blue component for run or blend. Also 

used as blue Brightness. 

3 ST_TRANS Start value of transparency component for run or blend. 

4 NO_REO End value of red component for run or blend. Also used 

as red Contrast. 

5 ND_GREEN End value of green component for run or blend. Also used 

as green Contrast. 

6 ND_BLUE End value of blue component for run or blend. Also used 

as blue Contrast. 

7 NO_TRANS End value of transparency component for run or blend. 

8 P_START„H Horizontal Page Start address. 

9 P_START_V Vertical Page Start address. 

10 S_START_H Horizontal Screen Start address. 

11 S_START_V Vertical Screen Start address. 

12 UCOOE Microcode register. 

13 ALT_RL Alternate run length register. 

14 T_OFF texture offset register. 
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Claims 
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25 4. 



A graphics engine to manipulate colour image data on a pixel-by-pixel basis «!airi ennin<» • • 

parallel data path for each one of three primary colours of said imagrda'reach safd nL^h ^ 
cascade connected interpolator and composil^r and said data pal betg connecte^rpa^Z^^^^^^^ I 
cascade connected transparency inteipolator and matte combiner wherein eacJ of saidS^^^^^ 
polators receive colour variation commands, each of said compositors receive colour nput data for llrh 
sa.d pixel in turn and said compositors transfom, said colour input data in a^^Sancrv^l ate d!tr 
mined function the output of which is dependent upon both the input colour da^and the^n Sr^^^^f 
ation command, and wherein said transparency interpolator recj;ves tranlparX var^^n^c^^^^^^ 
and said matte combiner receives matte plane input data for each said pixel and said can^hin^f^M 
a colour blend value and an output matte value for each said pixel bv trans olin^l^ f ^^ T^ 
in accordance with said transparency variation commands reouTputo TaTd 3 
image data simultaneously manipulated ascolour. transparency and matte 

A graphics engine as claimed in claim 1 wherein said colour variation commands are selected from th. 
group consisting of blends and colour correction. "manos are selected from the 

iZTTrT^^\^^^''"'^'^ ^ • ^^'^ colourvariation commands include a start value 

A graphics engine as claimed in any one of claims 1 to 3 wherein said transparency variation commands 
are selected from the group consisting of transparency blends and texturing commands 

^" S H,' H^^'^^T'T T"'^'^ ^"^ °^ '^^'""^ ' '° ^ 'f^^ transparency variation commands 

include a start value and an end value between which said input data is interpolated for a soecific hZ««! 
30 determined by the transparency variation commands. interpolated for a specific duration 

^' IT^TJ^T- °f Claims 1 to 5 wherein at least part of the image represented 

prede te'ted K '"""''^ appearance by said matte combiner and oolZd wS, a 

coCed holrl "i ' '=°'"P°«"°'-« form said image part which is simultaneously textured and 

dalrsaSra^e^j^'^ "^''^ '''' "^^'"^ '^^^"^^^ ^-^^^^ -'^^ ortex^f 

A colour image data manipulation system including a graphics engine as claimed in any one of claims 1 

A ramp generator comprising: 

means for storing a number (N) as a plurality of bits of information- 
mined:maxTm'Z:tT ' ''''''"■^ predetem,ined minimum and a predeter- 

of onPrT^n^"' ^h' '^f"^ ^^^i""^' Significant of said bits to establish either a step mode or a jump mode 

ir « H • ' ''^'^ '^''^ '^""^^^^^^ 3' ^ rate less than 1:1 and in saidTurnp 

the reaf hlTr T""T 1 ' '° °' °^ ^=1' ^^'^ number dete^Sg 

the real time taken for sa.d output to traveise between said minimum and said maximum. ^ 

TaZan^ !f f ^""^^J" 8 ^t^^rein said predetermined minimum is 0% of the interpolation 
range and sa.d predetemi.ned maximum is 1 00% of the interpolation range. erpoianon 

fnsrction."'"'"' ' °' ' ^"''^ ""'"•'^^ ~" '-"Sth of a graphics 

and Ta'!dT.'^?jrj'?'"^^ T "'"""^ ^ *° ''^ ^^'^ ""-"^er includes at least 8 bits 

rdeTsaTn^r fstst fS. ' ''''' ^-'^ " ^^^'^ ^ 

23 



35 



40 



45 



50 9, 

10. 

55 

11. 



BMSDOCID: <EP 0465250A2_I_> 



EP 0 465 250 A2 



12. A ramp generator as claimed in any one of claims 8 to 11 wherein said accumulator comprises a first mod- 
ule for calculating 255/(N-1), a second module for calculating (51 1-N) and a third module for calculating 
(512-2N), there being a first multiplexer connected to a zero vaue and an output of said second module, 
a second multiplexer connected to a constant (510) and the output of said third module and a third mul- 
tiplexer having inputs connected to the output of said first nrodule and the output of said second multiplexer, 
and adder having one input supplied by the output of said third multiplexer and outputting to a fourth mul- 
tiplexer having its other input connected to the output of said first multiplexer, and an accumulating flip 
flop connected to the output of said fourth multiplexer whose output supplied an output of said ramp 
generator and a second input to said adder. 

13. A ramp generator as claimed In claim 12, and comprising a counter connected to the output of said 
accumulating flip-flop and having its count value incremented thereby, and a fifth multiplexer having one 
input connected to the count value output of said counter and the other Input connected to said output of 
said fourth multiplexer, the output of said fifth multiplexer being switchable between said count value to 
provide a step mode ramp output and said fourth multiplexer output to provide an alternate, jump mode 
output. 

14. A graphics engine as claimed in claim 3 or claim 5 including the ramp generator as claimed In any one of 
claims 8 to 13 and wherein said specific duration determines the ramp output of the ramp generator. 

15. A desktop publishing system comprising a computer (1), a colour output device (3.7) and a rendering pro- 
cessor (10) arranged to perfonn rendering operations (e.g. colour fills, mattes, or mixing two images) to 
generate image data supplied to said output device. 

16. A system according to daim 15 which includes a workscreen memory (30) coupled to an image display 
apparatus (3) and a page memory (4) coupled to an image printer (7), said rendering processor (10) being 
anranged to access said memories (30, 4). 

1 7. Apparatus for processing image data to provide a colour image output, which comprises means for operat- 
ing upon red, green, blue, and matte or transparency information, wherein separate means are provided 
for each of the colour information and the matte infonmation is processed by one of said colour processing 
means. 

18. A graphics engine including a grading circuit arranged to interpolate across a run of pixels from a first value 
to a second value, said grading circuit including a digital counting circuit arranged to produce a ramp of 
successive values for use on successive pixels. 

19. Image processing apparatus comprising a rendering processor (10) for performing colour and matte oper- 
ations on image data and, coupled thereto, a scaling processor (9) arranged to accept image data and to 
produce output image data of a different resolution con-esponding thereto so as to expand or shrink por- 
tions of the image. 
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